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ABSTRACT " 

Two interventions of a university-based 
organizational development (OD) teaa with the adiinistrators of a 
local >5oard of Cooperative Educational Services (BOCES) are 
described. The intervention was invited by the new superintendent of 
the BOCES, The first intervention focused on sJcill development and 
goal clarification. Because of a crisis in the BOCES that occurred 
after the first intervention, the OD team was invited back. The 
second intervention emphasized renewing the skills learned in the 
eicst and then focused on interpersonal issues. Eventually, after the 
second intervention, the superintendent of the BOCES resigned. This 
consequence raises questions aJ30Ut th^ success of the interventions. 
Two implications are explored. The first has to do with 
evaluation-related issues and focuses on the relationships between OD 
efforts and organizational change. The second deals with the way OD 
•projects, by t^^^^ very na* ure, tend to shift in emphasis over time 
and in directions that are less process skill-oriented and more 
intergroup-, interperson- , and intrapersonal-oriented , 
(Author/IRT) 
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SOFT (PERCEPTUAL) AND HARD (OBSERVABLE BEHAVIORS) OOTCa^IES 
OF AN ORGANIZATIONAL DEVELOPMENT EFFORT IN 
AN INTERMEDIATE EDIICATIONAL UNIT 

Mike M. Mllstein 
with the assistance of Sister Dorothy Smith 

Between February of 1975 and January of 1976 an organizational de- 
velopment (OD) effort was conducted by a team f rcmi the State University 
of New Yorl; at Buffalo with the administrators from a local Board of 
Cooperative Educational Services (BOCES) . Some results of that effort 
could have been fairly well predicted, but others could not have been 
so easily foreseen. This paper will describe the project a^id attempt to 
establish outcomes* The "outcomes" are the intended and unintended at- 
titudinal ?.na behavioral changes on the part of the BOCES organization 
and on the part of individuals who ccrrpriss the administrative core of 
that organization. Major issues to which we had to respond and the rand-r, 
f ications they may have for other organizational development efforts will 
also be explored. Cf central interest here is the incradifc-le difficiaty 
of attempting to accurately establish relationships between OD efforts 
and identifiable changes. Also of interest is the tendency of OD pro- 
jects over. time to expand in purposes and to become increasingly and in- 
tensely focused upon interpersonal relations. 

THE SSTT/NG ^ 
To establish laboratory settings for its instructional program, the 
Department of Educational Administration at the Uhiversity offers af:sista.ic^ 
to educational systems that are able to identify organiarational problems 
that might be ameliorated with OD approaches. - Projects, which include 
intensive diagnostic and intervention activities, have varied in duration 
from several months to two or more years, depeiading upon the nreds 
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identified and the interest of the cooperating school setting in con- 
tinuing the effort.* 

One recent pocoject involved an intermediate school system. Tliis 
organization is but one of the more than .forty BOCES (Jistricts that have 
been created in New York State since 1948. Like its counterparts, this 
BOCES provides a variety Of services that local school systems cannot ef- 
ficiently or financially provide for themselves. There ere many such 
services, including planning (e.g., administering stirveys and doing re- 
seco^ch to establish needs for cooperative services) ? conducting vocational 
and technical education classes; organizing and conductljtig special edu- 
cation classes for physically handicapped, mentally retarded and emo- 
tionally disturbed children; providing instnictional filtr.s; and coordi- 
nating educational T.V. in local schools. School restricts join togethcr 
voluntarily to r3ceive EOCES services on a contractual basis. Once they 
have joined r. BOCES, school districts cannot choose to withdraw from the 
cooperative arrargement. . .-They can opt to maintain only a minimc.1 con- 
nection, paying their share of a<^ministrative costs but refusing to fi- 
nance cr cooperate with ECCrs sp.msored programs. Thus, BOCES e2:pand or 
contract in personnel and facilities depending upon the extent to whiclh 
districts view their services as desirable. Thay cannot grow merely be- 
cause of connections at the state capital; rather, they prosper to the 
extent that they offer meaningful educational services and aggressively 



*Thus far, cooperative efforts of a year or n^ore in duration have in- 
cluded two parochial high school faculties, a high school student senate, 
a district-wide aAcdnistrative team, the BOCES administrative staff de- 
scribed in this paper, and the professional staff of a rural school dis- 
trict. Shorter efforts have also been carried out in diverse public and 
I ivate school settings. 
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seek ever-broadening support from nvomher school districts • 

The BOCES of particulcir interest here was established in the 1950 's 
to serve the needs of a predominately rural population. Covering a large 
geographical area with a relatively small school-^aged population, this 
BCXIES could be typed as steady-state ^in orientation. That is, basic noeds 
were identified and the organization continued to serve these needs over 
time. Until several years ago, leadership was invested in the hands of 
the man who was first appointed to the position of jpistrict superintendent 
Most of his eight administrators, all but one of wh/)m are still with^ 
BOCES, were also hired in the eeurly days c5f the organization. 

As long as the t:omposltion of the constituent districts did not 
change continuity in leadership, personnel and prograra orientation was 
appropriate. However, by- 1970, population from the nearby motrcpolitan 
area was clearly overflowing into the district. BOCES now found Itself 
serving both largo and grc^>7irg suburban school districts and small and 
static rural sqhool districts. . ^ 

In 1973 substantial shifts began to occur in the BOCES staffing 
pattern. The encunODent suporintendent reached retirement age and de- 
cided to s'lbmit his resignation. In addition, two new program admini-^-^ 
strators were added to the organization. After an interim period of a 
year, thie BOCES board of education selected as its new superintendent 
one of the member district's chief school officers. This matt was widely 
known for his interest in educational innovations and for his skill in 
operationalizinq those innovations which he felt would be beneficial in 
his school district. As part of his agreement with the BOCES board, the 
new Superintendent filled a vacant assistant superintendent position 
with a man who had been working for him' as an administrative intern in 

O 
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his school district;»s central office. 

After several months in his ppst it becgnfe apparent to the new 
superintendent that there were thipee primary groups that would require 
considerable attention if he expected the BOCES to be able to meet the 
needs of a changing population. First, there were the member districtb' 
superintendents who, he felt, should play a major role in advising phe 
BOCES about the types of services it should offer. To facilitate this 
advisement tole he regularized district superintendents* meetings on a 
monthly basis. This provided opportunities for two-way information sharing 
and program guidcince . 

The second group thai: received the ouperintendent' s attention was 
the BOpns board of education. Because he wanted the board to become mere 
active in overall governance of the system he increased the nurber of 
formal board meetings and, whenever appropriate, included informational 
sessions on its meeting agendas. Unfortunately, this effort has not been 
very successful. The board has indeed becoirie more actively involved, but 
in ways that have proven to be detrimental. For example, scxne board rr.em- 
bers have interfered with program management and have even sought, even- 
tually with success, to oust the newer staff members and to force the 
BOCES superintendent and his, hand-picked assistant superintendent to re- 
sign. Although the problems associated with the board were never di- 
rectly confronted in the OD effort, they obviously played a large eon- 
textual role; severely limiting the BOCES administrators' sense of job 
and program security, and thus limiting their ability to respond ade- 
quately to the new administrative leadership and the district's population 
shifts. 

- The final group that the superintendent had to deal with xvas his own 



administrative staff. From the outset his goals for the -fitaff includod: 
1) clarification and updating of_E.OCES educational goals; 2) cocrddnation 
of established goals across programs; 3) institution of lAng-range plan* 
ning; and 4) promotion of team decision making • After several months on 
the job he concluded that staff members required substantial in-Service^ 
vjork to be able to meot these expectations • Therefore, he encouraged 
them to attend appropriate workshops that might be offered on relevaxit 
topics, commissioned a study to establish the planning needs of BCKJES, 
and instituted an internMJLy-operated management-by-objectives program. 
Finally, in an effort to improve the staff's ability to carry out tasks 
in a changing environment he contactad the author of this paper and it 
was agreod that a team of professors and students from the university's 
Department uo: Educational Administration, who had previous experience 
with CD, would initiate an OE> effort f or tlae"BKES adiainistrators. 



INITIAL INTERVENTION 

Diagnosis 

On the basis of what was discerned during the entry period, the OD 

team designed an interview instriament focusing on goals, policy, problem 

solving, decision making, communication, change e-nd interpersonal relations 

All members of the BOqES administrative staff were interviewed. Tlie ec- 

sence of the responses is sraTmarized below: 

Goals and Policy There is a set of written goals, most BOCES 

staff meirbers agree, but no policy handbook. 
(Over time, a set of written goals was located, 
but those goals had been drawn up before many 
of the present staff were hired.) 

Communications There are conmtunication problems, the focus of 

which is between B0C2S cex±ral atfalnli3trati*aa 
and the BOC&S principals. 
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Problent Solving Half of those* interviewed saw decisions made at 
fi Decision Making all lovals. The rest noted that decis.lons were 

made <it a level above tliem. 

-J ^ 

Change New leadership and a iJew budget emerged as the 

two most important chajiges. Staff members saw 
themselves* ac willing to accept reasonable charige; 
the superintendent viewed the staff as change re- 
sistant. 

Interp er sona l T\^o distinct perceptual groups were identified: 

Relarionships one saw the level of interpersonal trust as ade- 

quate, the other saw It as lcw« 

some further observations ma^e by OD team members include: staff 

^ ? 

members seemed to be primarily concernsd with**thGir own areas and did not 
have an all-pervading common concern for the total BOCES program; there 
was SOTie evidence of resis::ance to cli^Jige {e^., BOCES principals were 
frustrated wich the* new budget procjo^-:) ; and there were strong indications 



that the superintendent played a dominant role in establishing and dl- 
recting adiTiinii^trcitive processes. A number of staff members voiced con- 
cern over a lack of clear organizational directions and felt that they 
did not function effectively as a team. 

During April, a demonstrati<Sa v;orkshop was held at BOCES.* The p-or- 
pose was twofold: to continue the diagnostic process already begun and 

to prepare for the May workshop. Participation and cooperation in work- 
s' 

shop events were high. Critical 1£CCE:| issues at this time were seen as 
(1) communication within tha BOCES staff and between the BOCES field- 
based administrators and the central office staff, (2) the need 'co develop 
general goals and directives ,^3) the building up of teams- ar?d increasing 



*Two simulations were used^ ••Towers", and a pyramiding exercise which 
addressed issues and concerns about the coming OD workshop and j^cxmsed 
on further specification of critical BOCES issues. 
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trust, and (4) br widening the participation base for policy rt^akiiig. 
Woricshop • V 

/ VJith this pn-site experience and the resulting data in hand, the 

y 

actual intervention workshop was developed with BXES, Figure 1 sho^-zs 



the experiences in Which the BOCES staff participated, the purpose of 
the experiences, the relationship of the events to tlie diagnostic process 
emd the patterns of communication and behavior observed during the sessions. 

Figure #1 

Workshop Schedule - Events and Observatioais 



TIME 


EVEI^ 


PURPOSE 


— ^ 

RELATION TO 
DIAGl^QSIS 


CATION AND BEILWIOI 
priTTSP>f!S 


bAY 1 AM 


Triads 


Develop awareness 
of s!:ills needsd for 
effective coTmraii- 
cation - 


Ccctrnunioation 
citad as a cri- 
tical problem 


nxgn uvgree ci 
shared feelings 


DAY 1 AM 


Pi annfeyg 

rfb^ Hit ty^ ^ 0 

euld rpcratorfi 


Becomf) aWiMie of the 
dynaitiics of planning 

^. ■ ■ . 


Planning cited 
as a problem 
area 


Giving and a^.\ing i 
patterns quite 
balanced 


DAi 1 m 


Five Square 


Analyze aspects of 
ccx>pQration apd ccm- 
r. ;ti::ion; devel&pnent 
of .self awareness 


Felt needs in 
tliese areas 


Taking ovejc of td^K 
by tP;OSt s];illed 
participants 


DAY 1 m 

» 


iJorms 

Clarification 

0 


S!:ili development for 
thes^ processes 


Perception gaps 
in proup norms 


Shared feeling be- 
havior reduced; 
confrontation 1:3- 
havior began to 
appear 


DAY 1 PM 


Tinker Toy 

/ 


Cleirify group and in- 
dividual pejTceptions 
of organisational 
decision r-!:ing 


Perceptual di- 
chotoioies of 
"how things get 
done" 


CommunicuUion 
skills used by all 


DAY 2 AM 


Role Cla^ri- 
f ication\ 


Role spccificcition & 
information sharing 


Encximbents con- 
fusion, over 
thei^r functions 


Some did net payJ;i- 
cipate verbally at 
this point 


DAY 2 AM 


Clarification 
of goals 


Generate discussion ^ 
to facilitate goal 
setting 


Goal] setting 
given as inajor 
concern 


Superintendent did 
not participate 
verbally .at this^ 
point 


Day 2 PM 


Problems, 
Concerns and 
Conimitinents 


Focus on three of the 
most pressing issues 
along with actions to 
f olplow workshop 


Need "for "bat- 
tle plans" given 
as a major con- 
cern 


An increase of c^^n- 
frunting behavior 
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A study of the column "Observed Ccmiminication and Efel)avior ?atter::s" 

" - ' \ -* . ' ^ 

shows that, as the workshop moved ftom day one/ session one, to* the-la:rt * 
session of day two, observers saw less 'and- less shared feelings bchavioa: 
and > more and more confronting behavior. This behavior chahge later be- 
came dritical and will be explored further in the paper. 

During the course of the workshop, participants were aslced to evalu- 
ate each session. At the end of the second day they were asked to evalu- 
ate the ovyr-all wor::shop. The following figures summeirizo the respor:sc: 
that were given to the various evaluation probes. (All workshop parti- 
f^cipants responded.) 



Fig^are II 
Reactions to Individual Events 



TIMS 


' EVENIS 


RATItTG* 
» — 


DAY 1 a:i ^ 


Communi ration Skills 
Planners and Operators 


87.2% * 


DAY 1 HI 

• 


Five Square 

Norms C?:'riCication 

Tinker Toy 


■ 7.4.5 


DAY 2 AM 


Role Clarification 
Cli^rifxcation o^ Goals 


03.4 


DAY 2 PM 


<• 

Problems, Concerns, 
Commitments 


80.3 





Events Average 


83.5 



^Reactions were rated on a scale of 0-1^00% helpful for accomplishing 
tKe purposes of the events (see Figure 1 fox Purposes) 
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Figure III 
Reeu2tions to Total Vtorlcshop 





QUESTION 

■ </ 


1 


RATIITGS* 

2 3 4 


1. 


How much has the worlcshop changed your per- 
ception^ and understcuxdying of ^^fjum^JsmtiiXi^ 
processOB? 


50% 


50% - - ' 


2. 


How well do you feel yout colleagues worked to 
make the workshop experience a success? 


42 


58 - - 


3." 


How well do you feel .your problem solving 
skills were improved? 


25 


75 - - 


4.» 


How well do yovi feel- your decision ma^cing 


8 


84 3 ~ 



Skills were Improved?^ 

5, How much has this wor]:shop experience given - 50 50 
you noro self confidence in your vjor^cing 
relationships? 

6, Do you now have a better understanding of the 17 75 
goals of EOCES? 



18 



♦Reactions were rated on a scale of 1-4 with 1 the top rating. The % 
refers to thosa who chose a given rating • 

As seen from the ratings, tho p^irticipants' evaluation of the <^-ork- 
shop was positive, though Day I EM ratings too!; a dtp. possibly because 
of cro^rding (there were three seii^sions instead of two during that time 
period). The overall reactions give some food for thought • « Since prob- 
lem solving and decision mal:ing were not the focus of specific session:;, 
but rather pervaded the entire workshop process, haviiig bi^en exposed to 
these processes might npt have been as evident to participants as was e: 
posure to more direct skill trailing in communication. However, a "bet' 
understanding t)f goals" was a manor concern from the beginning of the 
diagnostic process to the end of ^he intervention v;orlcshop, so the fact 
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that one of the lowest ratings was, given to "a better understanding of 
goals" jnay be Ijnportant. ,It may be a signe^l telling that the workshop 
was a start, but that one of the major concerns of participants when the 
workshop started was still a concern when the workshop closed. DOCES 
nvembers^' views as seen through written commits on the evaluation ?!iQcta 
were of tmanlioou^ agreement that a closer relationship existed among- 
themselves because of the OD experience • ^ . . • 

.A study of the data gathered from the Group Expectation Survey in- 
strument li^ed before and, after the iiitei^yention provide^ some insights 
into what ki!)ds of perception clianges tool^ place during 'the intervention. 
iRiei^ uc^^d with groups the surv:ey typically reveals the following- patterns; 
ii) each ^rfirou2> n\€inber says that he is raceptiVo to interpersonal feedback 
. ' but tli^lt he perceives others as unwilling to give it and (2> each p3::con 
^^.^ys'-t^at tliouc;h he would report h^s feelings candidly, he doubts tliat 
othelJs would do the 'same. The pre and post-tests (Figiaye IV). slinw ^the 
' normally expected^ growth towards c;ivlng and jreeoiving feedback gifter 
having participated in the ^workshop. Also, items 13-24 show a slgnifi*- 
•cant growth pattern in the affective domain, an area of 'higher risk* thari^ , 
that of earlier survey Item?, Individual ir embers' expectations increasec! 
at a much higher rate thcxn did members' perceptions of the openness of 
the group. As a result, 4:hG .gajl^ between* hov; inSividuil^ perceived tli^tb*^ 
selves regarding shared feelings (items 5 iand 11 on the chart) and what 
thoy expected from the group actually 'increased, instead of decreased as^ « 
might have been expected • Perhaps a ir^ ii.ority 9* individual members ^^*aw 
themselves' as more upen^ but were still quite unsxire as* to whetl^r avery- 
one else, i.e., the *'group", was mcviag in the same direction* The tindin^js 
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on this sxirvey regarding shared feelii^as correspond to the patterns of 
behavior fo\and in Figvire I on pags 7. 

Action Plans 

During the last session of the workshop, BCXSSS members were asked 
to identify their three most pressing issvies and to develop some action 
strategies for dealing with them. Plans formulated during this session 
are listed below, as well as the outcomes to date. 



Figure V 
Action Plains and Strategies 



ACTION PL*iNNING 
PPvIORITIES 


STRATEGIES 


TARGET 
DATE 


oirpcc>!ft5= 


1. Identify, clarify and 
prioritize goals, gain 
.consensus between BOCES 
administrators and the 
Board on aoal state- 
ments. ' } ^ 


1. Meetings-BOCES Board 
and Chief School Of- 
ficers for "Program 
Tie view" 

2. Finalize goal statement 
by staff 

3. See:: consensus for goal 
statement, from Chief 
Schoo^. Officers & com- 
ponent districts. . , 

4. BOC^S Board-confirm 
goal stD-f-f rr^nt. 


May 

Jime 

Sicnmer- 
Sept. 

Oct. 


1. Accomplished 

2. Accomplished 

3. Accomplished 
Accomplished 

4. Accomplished 


2 1 

2. Wop]: tov;ards open com- 
munication along with 
increased confiden- 
tiality. 


1. June Staff moetip.g to 
set up worl:shop for 

a. identification of 
r;!:ill needs 

b. development of trjst 

c. development of group 
unity 


June 


WorK&ho;^ Held 


3. Improve total or^jani- 
xational planning 
capacity. 


1. ilBO in--service wcrl: 

2. Articul:;tion boti^een 
departments to develop 
strategies and clarify 
roles 

3. Yearly Planning Calendar 

4. Ratrefttfe and workshops 
on special topics 


July 
Nov. 

Sept. 
Through- 
out 
yeeu: 


1. Accomplished 

2. Ongoing 

3:. Accomplished' 
lleui a special 
meeting on bud- 
geting 
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If this OD intervention was to be judged on the basis of v/hether or 
not the action plans formulated d\u:ing the sessions were actively car- 
ried out, this record of accomplishment would seem to insure a high 
rate of success* 

The ov^all picture of this workshop, as viewed in the evaluations 
of individual sessions, tlie evaluations of the OD work as a whole, and 
the overall results of the Group Expectations Survey, would indicate 
that the OD project had been effective. Further, movement on the. action 
plans indicated BOCES was on the Way to becoming a self-renewing organi- 
zation. 

INTERIM PERIOD 

On July 1, 1975, the BOCES superintendent recijived a letter signed 
by. seven of the BOCES administrators^, stating that their primary concern 
was "providing quality programs and extending opportunities for the stu- 
dents v/e serve.;." Further, the lettar stated, &3£;pit3 ncmy o£SostBf- 
several issues remained unresolved. Thare fo31ov7ed a list' of issues 
about which the signers were seeking "clarification and direction". . 
There were nine issues listed, six of which did. not seem to have been 
addressed in any of tlie statements made by BOCES participants prior to 
or during the workshop and tlire::^ v'^i-h the OD team thought had been ad- 
dressed. The six new issues i;ers: ^ 

1. Procediires for submission of program proposals, particu- 
larly those involving students, to avoid the delays 
which have occurred this year and insure proper priorities. 
(List of programs followed.) 
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2. Clarification of v/ho should participate in administrative 
staff meetings and constituency of the administrative staff • 

3. Policies regarding selection of administrative staff for 
« attendcuice at conferences, nuicber of conferences within 

each depcu±ment, procedure for request and approval of 
conferences within each depeurbnent* , 

4. Written notification of accumulated sick leave / personal 
leave, and vacation t.1ine for the past five years and a policy 

" stateinent as to the disposition of vacation time* 

5 m Consi^deration of recponsibillty changes during the school 
year, sala3;y statcrnents specifying doratlon of oocimltmcnt 
and consideration of adjustment of contract commitment. 
Development of a progressive administrative salaary schedule, 

6, AdnJijiistrative salaxy adjustment to be made July 1 rather 
than after teacher negotiation settlements* 

" The issues that V7sre related to the OD effort wore: 

7. Davelopnent of job descriptions and cleirif ication of job 
recponsibilities , 

0, Development of acPolicy hemdbook. 
9, Developtent ol: an orgsmizational staff cliart* 
In the letter, vhich called for a written response fcy At^jdst 15, 
they stated their belief that the resolution of these issues would acr 
hance the "development of a strong, u;iil:ied, viable stciff, able to pre- 
sent quality programs to students'*. The new issues seem to have been 
reflections of the economic crunch thct was hitting school systems through* 
out the state at that time. Inclusion of issues that had been addressed 
at the earlier workshop, hoxv-ever, seem to indicate a perceptual gap be- 
tween the BOCES administrators end the University team concexming move*- - 
ment towards a renewing organisation. The l3tter signalled a shift in 
what, up to that point, had seemed to be a highly successful ax^d seem- 
ingly predictable OD intervention. At precisely the time when the OD 
O team's contract was completed, the BOCSS staff moved Into a new phase 

ERIC 17 
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A NEW CONTRACT IS ESTABLISHED 
By the ena of the summer it was apparent that a high level of ten- 
sion existed among the BOCES administrators. The conflicts of tlie summer 
were not resolved and staff members were openly stating concerns about 
the BOCES* ability to meet the needs of member school districts • in fact^ 
the superintendent told his staff infonjally that because of the growing 
intensity of the conflict he was ccMisidering resigning. At a staff 
meeting in August agreement was reached that further in-service work was 
required, especially in the areas of communications and conflict resb^ 
lution. The superintendent was asked to reestablish relations with the 
University's ob team. 
. . The new request was reviewed by.Uia involved uxiivdrsity personnel* . 
c They realized that this was a most critical junctiure; the ^ formal agree- 
ment between the University and the BOCES had come to an end so they 
would need to work under new ground rules. Focusing upoQ skill develop- 
ment and goal clarification the initial proj3ct had been of a relatively 
low risk nature. Now the focus would be upon int :rpersonal issues at a 
time of. severe conflict within Lhe administrative group (as v;ell as witih 
the governing board) ^* The initial effort could be profiled as one which 
progressed from skill development and a general sharing of ideas among 

♦Casting a ccmtinning shadow over the project were the negative attitudes 
of some members of the governing board towards the new superintendent and 
his program thrusts. But, as, noted earlier, it was beyond the legitimate 
bovinds of the University team to deal with this problem since the con- 
tract was with the professional staff. The board viewed itself as totally 
outside of the effort and resisted all efforts to be involved This sliort- 
coming was critical for it precluded our ability tq deal with one of the 
major groups contributing to the problems that were being clarified. 

ERIC 
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1 

participants to a willingness and openness to deal with confrontations 
which occurred towards the latter half ef the project • Thir, pattern in- • 
dicates a shift froitr working for acceptance as individuals by the total 
group, as well as by the University facilitators, through a rawarding 
and confidence building phase when most individuals began to feel accepted, 
and into a third phase when individuals felt secure enough to rislc con- 
frontations that had rnmainGd latent until that^time. Unfortunately, 
the initial contract with BOCES was concluded when this third phase was 
just being reached. In retrospect, we believe that a continu^ation of the 
relationship at that critical juncture may have been beneficial to the 
BOCES staff, helping to make the necessary transition between established 
and cmerginq norrac and behaviors. 

'A SLicond Diarjnosic 

Racogniiiii.cj that the dynamics of the situation had become so ex- 
plosive, it l:o lewe responsibility for the design and irn- 
plemontaticn of the f-ll efforts to the t'.70 faculty members who had 
guided the initial OD project. The BOCES administrators agreed to attend 
another workshop. Prior to that event cach'BOCES staff member was inter-- 
viewed to ascertain current estimates of thoir situation. The interviews, 
which lasted appLOxiTn?±.-.ly 30 s each, centered upon identification 
of th^jfT^jor problu-is that v;^.r.. b^^iiij encountered, the perceived causes, 
and the strengths which tho group felt they cduld employ to overcome 
thoir prnblons. In addition, they were asked to clarify what they hoped 
would be the outcome of tho workshop experience. On this last question 
there was- considerable interest in having morobers Of the group learn to^ 
^ „ connunicato better, *to "level with each other", and to "clear the air" 
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\*xere conflict3 were constraining thoir productivity. 

ft 

In analyzing the results of the interviews it became clear that most 
group members saw the same problems. It also became obvious that they 
did not loiow that this was the case. Either they had not talcen the time 
or else they had not been open to sharing concerns with one another. 
Therefore, it seemed that the most useful thing to do would be to cloister 
the adnliiistrative staff over a few days for an intensive and, hopafullyr 
open exchange focusing on interpersonal and intergroup problcin cleir if id- 
eation and resolution. 

Second VIorhshop 

The ovornite vorl:shop (t'.7o~cT-d-a-half days) was • scheduled for October 
at a resort some fifty miles from the BOCES central office* The initial 
sessions were used to provide feedback to gl:oup mam^bers to show them that 
the communications s]:ills (e.g., paraphrasing, perception checking and 
sharing of feolin^js) learned during the first phase of the initial work- 
shop ha(3 quiclcly slipped frCm use when the University team relaxed its 
central focus on them. Happily, for the remainder -of the Second work- 
shop most mGmbers conscientiously practiced tLesc skills. 

Because significant similarities in responses to intorvi<|w' questions 

were found, the group wis then urged to accept ownership of the problems 

t. 

identified. To facilitate this objective the priority problems identi- 
fied in the interviev;s v/ere typed on three--by-f ive cards and ronddmly 
rj^st-vj^n-hiari anvnng members of the group. They were asked to share their 
information so that the group could identifjjiihajor problem themes. ^ After 
extensive discussion and, in some cases, individual disclosure of author- 
ship of statements, the group derivecl the following problems composita: 

20 
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— "The nuain problem is Intenvil trust, 'finking and leaks'"; 

— •T!iere is ineffective communications and inadequate infor- 
mation flow" (up, down and across) ; 

— "we don't have a united front (solidarity) when we work with 
the boaucd"; 

— "There is a lack of confidence in central office leadership"! 
~ "We lack a clear and unified pi^ilosophy" 

Tl:o group was then asked to abstract priority problems that should 

be confronted d\tring the workshop. They decided to spend the remainder 

of the retreat on the priority issues cf intergroup role clarification 

(i.e.^ central office and the rest of the staff) and wc».ys of resolving 

conflicts between the aroup and the superii>tendent. This ended the first 

{ 

day's activities* ^ 

*1 

Most of the second day x/as given over to an Jitiagingf exercise , f o- 
cusing upon central' of f ice persoxinel — the superintendent, ahd the tWo 
assistcxnt superintendents — as one iniaging* group find the rest of the 
administrators, who snon adopted the label Of "middle mancgemcnt", as 

r S. 

the other grovjp. Some sg] acted results of the exercises are summarized 
here (Figure VI) to give the reader a sense of the interactions that oc- 
cur red 

As expected, -the fexercise restrained the participants' tendencies 
^ to place blame for conflicts on others and encouraged them to focus vipon 
their own contr4i5utions« Most of the BOCES staff group did come to re- 
cognize their persohal and sub-group 'is tsontrlbutloas tholr probl^f^^^. 

I, 

*In an imaging esrercise two groups euro given a two-part assignment • Each 
group develops ai* image (description) of itself and an image of the 
other group based upon- observed behaviors • Images, favorable and un- 
favorable, axe recoided and shared • The sharing process ic taken through 
several stages, usually requiring 1^ to 2 days. SJee footnote 1. 
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Pigizre VI 
Imaging Exercise 

Middle Management (MM) as Inaqed by Central Offi ce Staff (COS) 
I. Individually reluctant to cheunge. 

Examples: Utwilling to accept new budget procedures 
Lack of support for new progrcmfl 
Reluctance to support philosophy of "mainstreaming" 
Uav7illing to accent unorthodox philosophy of 

occupational education 
Lacic of commitment for M.B.a procedures 

m»s Response: We will adopt new budgetary processes 
We will accept M,B,0, procedures 

II • Crisis oriented*. 

Examplec: Unwilling to write 5-year plan, four yearo after 
due datel 

Mo contingency" plons for transportation program 
Proposals sxibmitted after programs should have 

been ijistituted , ^ 

Lack of prior planning for programs 

' mVs Response: Five ysrr plans have bean submitted (even if 

late) 

Prescribed administrative procedures should 

be jointly developed 

vie will make mere efforts at long-raiige planniiij 

III. Concern about CC3»s tasks interferes with MM«s primary task » 
of working with/for -nhildron, 

Examples: Creating a "paper mill" — apparent need" for ixSfor- 

mation that dg not directly related to jobs 
Over-involved w\th COS procedures 
Statements of "feeling left out" 

MM's Response: COS should sand us information that goes to 
districts 

•1^^ Initial stages of new procedures should in- 

' volve MM do we will understand our roles 

and responsibilities 
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Figure VI (Continued) ^ 
Imaging Exorcise 

IV* Lack of evaluation laetJiods for particular programs. 

Examples: No response to COS's erTaluation^strurnont for 
^ special education 

No Iniilt-iji mechanisms for program ^valuation 

». 

MM's Response: We recognize this 

^Wemnts are being made to overcome it 
V7e need cussistance 

Central Office Staff (COS) as "linlqed by Middle ft^nayc^ent (MM) 

♦ 

I. COS is unconcerned with/MM staff moniberSf both personally and 
with their organizational goals 

Examples: COS does not respond, or, responds slowly, to recroeats 
Lack of formal evaluation process for administrative 
staff 

* Transfer of tariks away from some MM staff diminishes 
roles 

Individual m staff not receiving information they 
feel is important ^ - 

COS Rasponaat A priority COS task will be to get a formal 
evaluation process going 
You must understand role-task assignments will 
continue to be modified, but we will discuss 
th'^m with ycu before institution . 

II. COS is concerned with self- image an^ organizational image es op-, 
posed to student needs. 

> »i 

- ' Examples: ^ top pribrity organizational objective is to pro- 
mote BOCES Ixiage 
lios action on student service program has been 

~ \/ delayed 



COS Response; We think your image and examples of behaviors 

]^flects confusion about goals and objectives 
in the organization 

Goal setting will continue as will goal achievemeu'*: 

Goals will be reviewed annually 
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Figvire VI (Continued) • 
Imaging Esrercise 

III. COS is unresponsive to stcff requests and needs (personal 
cind progroxomatic) • 

Examples: Delays of submission of MM proposals* to the board 

Iij^attention to salary concerns of Wi ^ 
^ mm membership on advisory commltteea 

COS Response: Planning and processing of proposals will be 
/ . cctlendared and clarified, hopefully expe- 

^ i - ditlng the problem 

IV. Ideas and actions that do not originate in the central office 
are minimized. 

Examples; MM suggested vocational and pre-Vocatioral progrsiTis 
aren't instituted 
V COS emphasis on own programs rather tban MM preferences 

COS Rasponse: We recognize legitimacy of exeanples given, but 
selection of programs and projects will con- 
tinua to depend upon their congruence with or- 
ganizational goals and objectives 
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Most importeuxt, as the super intondent interacted with various group raor.** 
bers throughout the exercise, it became clear that he was net '•out to 
get" any particular individuals. f , 

As the day prcigrer.sed remarks directed at the superintendent became 
. Increasingly f riencUy and supportive. In addition, thcire were repeated 
requests for him' to clarify his status, 'Specifically, the group wanted 
to know if he intended to rosi«jri as superintendent at the end of the 
1975-76 acad^?mlc yoar as he had indicated on several earlier occasions, 
or whether he was willing to nuike a continixing comndtmanf as their leader • 

At \he end of day two the facilitators held a conference \;ith the 
superintendent to clarify this issue * The upsliot of the conference was 
that he proxisod to think throutgh the re^quest and to lead the f:«ssion 
the no:ct day* At that session ho tc3d the group that interpersonal and 
intergroup problem resolution was intportant and that hio belief in the 
possibility of problem resolul-^on had iricreased as a result of the work- < 
shop interactions. However, he stated that while this was necessary it 
would not be sufficient cause* for him to change his earlier decision. 
In effect, he told then: "Doh»t t4ll me you are with rae unless yoit cf.n 
agree with my educational objectives," He then proceeded to verbal:.zn 
about the philosophical tc^nots that were at the cere of his educational 
belief system. As far as can :>e accertained, this was the first tin\o: 
that the group had extencively explored educational values. The discus-- 
sion was smiraated but time was running out. Therefore, an action pl5Ui 
to follow-up the workshop ^as agreed upon. Sequentially, th^e super in- ^ 
tendent would pitt his thoughts together on paper; the group would review 
the document; and the tot^l staff would reconvene in one week at one of 
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their honi^ to spend the aftemooi\ discusc'lng it.*- The apeclf ied-gjrrpos-j ^ 
of the £ollow-up meeting was to clarify tne**group's unaerstanclin.3 of tha 
superiJitoindent's educatioitai philosophy and to discover whether it was 
compatible with their own educational values. The suoarlntendfini promisad 

t * 

to give/serious consideration to remaining on in his post if it became 
clear that there waa cubstantial agreittr«nt. If, on the other hand, there 
was not agreement he emphasizes that it would make sanco to admit the 
dispartt^jBs eftid proceed with his earlier-statod Intentions of resignioju^ 

Post-VIorkohop Events ^ 

As proi^ac , the superintendent wrote his position paper and dis- 
tributod it for review. In that pap^^ life pyopocod that^ youngstea: 
shot4d ^fail'. .the concept of •scero rejects' is an achievable goal for 
our educational institut£oAs...*mainstream±ng» spacial education stu- • 
dents is appropriate and BOCES should help member districts to ttiplemarit 
this concept." • • 

He also started his belief in a "post-industrial society* that will 
be noto^f for, "limited econonic gi.o\rth c^nd change ...decentralization 
of most .large institutions ..Siparticipatbry politics ...emphasis on craJt- 
based activities ...wealth $hifts rather than constant accvmiulation of 
more material goods ...low energy tools to replace many current technc^ 
logic*:, which are destroying the planet ^. . .siinplor living ' styles and sa^al- 
ler community clusters ...emoiiasis on self-reliance and. group reliance 
rathcjr than chronic dependence on larga institutions*"* ^ 

He concluded that, he wished to spend the r6st of his professional 

life "designing, developing and implementing those educational exper- * * 

f?(^ ■ > 

'iences that lead in that direction" • These experiences would include 
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"^j)hasis on people loyalties ...conf^tant search for individuality 

• ••desire to personally malce do with low ene^igy tools •••0 sense Of 
mystery and awe for the n^^tural environiQent and all living things ...(and 
a) belief in the need for hiiman limits". Noting that since the retreat 
several staff members had said his jAiilosophy was like "motherhood and 
apple-pie ...who co\ild disagree?" he asked the group to consider whether 
thoir own prcgran^ priorities would "lead to the rulfillircnt of the gen- 
eral statement" and, if not^ "what changes are suggested." 

At the folla-z-up meeting the facilitator encouraged members of the 
group to question tho superintendent alrout aspects of his philosophy th; 
might still be uiiclear to them. Next; they were urged to clarify how 
they felt the superintendent's statement might alter their programs. 
Following a lengthy and open-anded discussioi^ each staff member was asx'jc* 
to write out responses to the following questions: 

* 1. Do you gererally a<jro9 with the superintendent's philosophical 

£, ^sifcion eind educational goals? 

2. ' Do yoru anree as they affect your particular programs? ^ 

3. Does tho statemcint present you with any special problems as 
^ you carry out you:::^ activities? * . * 

Each staff member was then encouraged to p(jblicly share his recponses. 

These responses are presented in Figuare VII, 

As Figxire VH illustrates there was close to consensus agreeme»t 

at the general level. Hov;ever, as .the members of the s^ff were urged 

to particularize the philosophy as it related to. their individual as^cn 

ments there were many reservations; only two of nine saw no problems* 

' for their situations. There were clearly evident differences in valued 

and in willingness to accept *risks. By the end of the meet ing.it had . 
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become apparent to those in attendance that there was a wide gap in ex- 
pectations. However, rather than ta!;© any action e.t the tiaie, tlie group 
decidedto reconvene in a week to decide whether, aCter further thought, 
there might still ways of .iarrowing the gaps. Not surprisingly, at 
that meeting tlie group concluded that their differences with the super- 
intenfient were significant and i^obably Ixisurmountabio* This conclrsion 
was realistic, as evidenced by a set of goal statements that the group 
derived for their DOCES later that year. Tliese goal statements were 
maintenance oriented (e.g., maintain communications with school districts; 
establish educational needs in the area serviced; improve the quality ^ 
and efficiency of services provided; and instire the availability of ado- 
q\iate facilities as needed) . Noirhere in this document can be found the 
kind of goal statements for education that are of the aatiire of the super- 
intendent* s estixoation of a "post industrial society". 

Within tv7o wec!:3 of the "ttarrov/ing the gap" meeting the superintendent: 
sxabmitted his forraal resignation to the governing board to take, effect 
at the end of the academic year. The choice of timing for submitting hi^ 
resignation was triggered by a stepped-«p cconpaign by the antagonistic 
faction of the board of education. However, as a result of the fall's 
in-service worl: it had already become inevitable that he would step do^vn* 

OUTCOMES 

Concerning the impact of this organizational development project one 
ihiOlxt IJdtially conclude that "the operation was a success but the pa- 
tient died". However, this rather simplistic conclusion does not hold 
up under closer scrutiny. The short-range goals established in the fitct 
phase of the project were at least partially achieved • Group members 
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ol±cl come to trust each other to work, together to a greater extent than 
was previously the case. Organizational skills were learned and the 
group was able to develop ani agree upon a set of actions to be pursued 
to Improve the organization's ability to carry out its tasks • At least 
several of the action statements were actually accomplished. 

At this point, however r establishing outcomes bocoiaes more diffi- 
cult. Daring the summer, when much of the conflict escalation occurred, 
one might conclude that the * evohte held during the spring were counter- 
productive because they contributed to mutinous activities • The skills 
learned were employed in ways that created a 6risis. However, they could 
also have been turned towards promoting a sense of "togetherness" as ^ 
. easily as they Were to increasing divisiveness. The skills learned did 
not cause the conflict. VJhat does appear to be the case is that tlio 
skills made it possible for "middle ir^anagement" to be more effective in 
a direction that, i^ all probability, had.been set long before the events 
of the summer. From this perspective, one could -say that the original 
contract was incomplGte. It should liave included more emphasis on incax- 
personal relations; probably at least eqtialling the emphasis given to . 
process skill develdpment. Looking back at the results of the initial^ 
interviews v;e can find traces- of the remarks that finally surfaced in 
the formal correspondence of the srjnner. VJhy these concerns did not 

arise at the spring workshop may be at least partially e:iplained by the 

i 

tendency of groups to approach openness cautiously. But it may also be 
due to the fact that the initial intervention did not include sessions 
specifically structured to get at these issues. The lesson is clear: ^ 
leatning sl:ills is not enough. People must also learn to share needs. 
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feelings, and hidden agendas. 

i; It is even more difficult to make jiidgments about the fall activitisc 
cind especially abpv\t th^ ultimate resignat3.on of the superintendent. 
In-service work carried out at this stage was well beyond the parameters 
of the original contract, but it was at least partly required because of 
the original effort. At tliis stage the project was viewed by the Uni- 
versity facilitators as salvage in nature. That is, the conflict had 
already erupted and now the client group was looking for ways to re- 
establish cboperative working relations. Since the superiaitendent la- 
tojoately concluded that he imist resign the project might be deened a 
failure. 

Hov7avcr, this conclusion may bo overly pccsimistic. There are situ- 
ations when it is necessary for individuals to leave organisations, both 
for their own and for the organizaticn's bettdrment. I^ie philosophy and 
educational goals of tho superintendent were substantially at odcis with 
„ those of his staff. He thought this was the case but his administrators 
did not SGcm to grnsp this ronlity.^ They were absorbed with maintenance 
issues that. really did not matter if they disagreed with the purpos3s and 
program preferences of their leader. By the close of the fall activities 
there was a clcr-ir understanding by the group that the gap existed and, 
more important, that it was not lilcoly to be overcome. This understana- 
ing was necessary if the group was to suirvive with the morale required 
to continue efforts un<?.--r new leadership. Without this understandi)ig 
there would inevitably have been anxieties among the group's members 
over their individual roles in the resignation of the superintendent. 
When interviews are held between EOCES administrators and candidates for 
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the superintendency it is very probable that there will be questions 
thif seek clarification of educational goals as well as the usual ques- 
tions that* explore leadership styles 

THOUGHTS ABOUT THE STATE OP tHE ART 
The case ^described herein is not so idiosincratic that the iaipli- 
cations can be dismissed as irrelevant to the future of organizational 
development in educational settings. My experience over a nujrbor of 
years leads me to conclude that, while every eifort presents unique chal- 
lenges, there are similarities that cut acxoss most CD projects. In 
most cases it is quite difficult to accturately identify imd measure or- 

• } 

( 

ganizational ch>Mige and ou':comes. Still, the cooiplexity off the issue 
is no excuse for net attempting to evaluate OD projects. 

What are seme of the larger implications that seem eereclai^ 
worth exploring? I thinli there are two in particular that were ld.gh- 
lighted by the caso: evalualiion-related issuGS and the shifting and eve-.r 
more interpersonal levels to which OD projects tend to move. Beginning 
with evalmtion , there are sevcval concerns that have occupied the think- 
ing of OD consultants who try to establish relationships between their 

2 

efforts and organizational change: 

1. Where decs the mosb effective balance lie between the need 
to gabher information to assess the impact of an OD project 
and the need to maintain positive consultant-client relations? 
Insufficient data gathering may cause the consultant to design 
intervention strategies that are inappropriate. Too many re- 
"quests for information can result in z^ients becoming unhappy 
about ".excessive" intrusions on their busy work schedules. It 
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is most difficult to say where the balcince lies, because it 
varies from project to project, dependii>g upon the nature of 
the problem and the composition of the client group. 
How ccin we even hazard a guess* at cause-and-effect relation- 
ships between an OD effort and its consequences? This can 
only be done if v;e can. say something about the initial status 
of organizations, and if we have devised indicators to show 
short-rtoge Impacts while projects are in effect • Evaluation 
should be a process that begins with the iijitial client con- 
tact. In this sense diagnosis is the earliest stage of evalu- 
ation. Evaluation ought to encompass base-line data and in- 
stream data as well as outcome data. 

What are wa evaluating? The tendency is to evaluate growth 
in procoss skills of individuals and groups. This is appro- 
priate but prdbcd^ly insufficient, nhen we bring people to- 
gether to improve their ability to make decisions or to set 
goals, we are, at the sane time goipg to have an Impact upon 
interpersonal arA intorgroup relations. My own ex|)erience io 
that skills teaching is a fairly man^igeable task, but it is 
affected by, anC in turn affects, the d^-namics of how individ- 
uals and groups interact with each other. If evaluations of 
00 efforts focus solely upon skills development, a partial, and 
thus inaccurate, portrait will be darived. 
Given the dyx^ic interplay of orgemizational events, inter- 
personal and inter group relations, and skill development, can 
we adequately evaluate OD efforts with a single type of 
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instrumentation? It becomes ever-roore clear that cvalu;iti.ons 
must be multii-faceted* They should include a combination of 
approaches such as questionnaires, interviews, observations, 
• documentation and whatever else may be appropriate for a par- 

/ ticular setting. There is also the issue of standardized iJi- 

stniments vs. tailor-made instruments. In roost instances it 
is likely that some combination of the two is appropriate # 
St'andardizrid instruments lend a sense of reliability to the 
resultant data but they cannot possibly provide a complete and 
accurate picture because every OD project is uiiiq:ao in some way 
due to the setting, the. problems and the people involved. 
5. Ccx\ we be confident about the predictive power of our evalu- 
ations? Even if evaluations are carried out at appropriate 
poiiat a- in-time, are multi^faceted, and seek e:±ensive informa- 
tion, their usefuln-.s's will still be severely limited because 
such portraits of indivi-!w.ls ajid groups canrxOt be accurate fwr 

more than a short time. Pebple and groups change over time and, 

3 ' 
often, in xmexpocted clircctions. VTe know, for example, that 

skills are soon forgotten unless there are purposeful and con- 
tinuing efforts to secure them among group members in ways that 
encourage chancjes in norms and )5ehavior patterns. v:e also kmw 
that unanticipated events, such as community crises or break- 
downs in collective negotiations^ can do much to abort the Impact 
of OD efforts. This ooQly reinforces the notion that evaluation 
should be viewed as a continuous effort so that we can be a bit 
more certain that what was viewed as a reality yesterday remalno 
one today. 
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When is an evaluatidn completed? In most cases vjb have viewed 
evaluatixm as terminating at the point when consultants and 
cJLlents part compeiny. However, while the actual liitervcntioh 
Is tlme-bcund, the impact upon the organization is not. Since 
the i)ay-off lies in the organization's ability to respond to 
futu^re needs, the full test of the OD effort can only bo es- 
tablished over a period of years • Short-range and nid-range* 
project outgomes are certainly important to ascertain, but only 
as indicators of prob€ibIft long-rsmge outcomes. We know that 
organizational change takes years; why not then evaluate out- 
comes over an extensive time period? 

Finally, can we really aofino "success"? This is & most dif- 
ficult concept to opcrationalize* In the present case, for ex- 
ample, the original contract see:iied to have been fulfilled &o 
the evaluation might indicate "success". However, the project 
seemed to contribute to sube^quent conflicts and, eventually, 
to the resignation of the superintendent. In this sense, was 
the project a "fojJLure"? I think not, because the resignation 
may well have been the most appropriate course cf action for 
both the superintendent and for the organization. In the long 
run, can an organization, an OD effort, or a person for that 
matter, be a "success" or a "failure"? Life is as it is lived 
and organizations axe as they are; both successas and failures 
occur on a continuing basis. Indicators of movement such as 
personal health, organizational health, self-awareness and 
ability to cope, axe the things that HO are really looking at. 
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We are dealing in an arfina that is composed of complax huraan 
interactions, choices and values, we ought to take the "success" 
and "failure" glasses off and look at things as they are and 
for themselves. 

-The second issue is that pf the shifting nat ure of OP contracts. 
There are many levels at which a contract can bo made between an outsida 
consultant and a client organization. These levels range from (1) Oper- 
ations research or analysis and the evaluation of individual peirformanca 
to (2) management by objectives, (3) Instrucnental process analysis, 
(4) the quality of human relationships and (5) Sjatixp&iscaal' ■ analysis 
OD efforts focus on the Icst threfe of these levels. Frequently, the 
tendency is to initiate a contract at the least hazardous, or process^ 
analysis level. If identifiable problems can bo dealt with at this Isvel 
it is appropriate to keep the major emphasis here rather than to move 
towards the more hazardous and doepnr levels of human relationships and 
iatraperBOoal . analysis. However, in my experience, projects that con- 
tinue for more than several months seem to move inexorably from inter- 
mediate to deeper levels of interveBtions. Once the initial agenda of 
objectives are addressed it becomes possible to confront the more risk- 
oriented levels that are ever-present, but which orgwiizational merabors 
have resisted confronting prior to their initial l»*service work. 

projects, by their very nature, tend to shift in emphasis over 
tiine an^ in directions that are less process skill-briented and more 
intergroup, interpersonal and intrapersonally oriented. This is not to 
say that this is tnappropria^ie; rather it se^s to be a fact of OD life. 
This fact must be taken into account when attemptixig to evaluate what 
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has been done. Fron time 1, to time 2, through time n and bejoncl, OD 

projects are likely iio change in focus/. OD consultants have tD be able 
'\ to^^ke this phenomenon into account,; modify strategies , and iraasure 
results accordingly. 

In closing, I would like to comment about OD's present llxnitationn. 
OD, as an approach to organisational cliange is still in its infancy; 
especially so In education. In fact, the term OD only began to creep 
into the litoratoire on educiitional phange within the past two decades 
and the pioneering efforts in educational settings began onlyr during 

■ the mid-1960s, \nxile sane educators, especially university-based edu- 
cators, are rallying to Its baimer, there is still a paucit^ of evidenca 

. that OD can really achieve what its gurus have premised. It is a bit 
frustrating to conclucle that vhat is needed ic> fyx^thox research. But 
this does appear to be the case. 00 projects are being^ conducted in 
educatior.al settings across the country but there seem to be precious 
few serious atte^apts to monitor the results of these efforts. 

In this paper I hnvo athcmpted to highlight «pme of the major evalu- 
ation-related issues that have bGC:.i of concern in my o\m OD work. I am 
sure that there are other issues that will be brought out in the other 
papers presented at this sym^josium. Wo are at a x:ritical juncture, 
until we can respond, to the issues raised op will remain only aix inter- 
esting art that some consultants and ed^icational leaders praise and a 
few practice rather than the main-line strategy for changing American 
education that ^it has given- promise of becoming. 
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